Image based Face Sketch-to-Photo via Online Coupled Dictionary Learning
نویسندگان
چکیده
Image based sketch-to-photo synthesis has received intensive attentions in recent years because of its potential applications on both digital entertainment and law enforcement. In this paper, we study the hallucination of face photos from a collection of face sketches. Before the hallucinating synthesis, a coupled dictionary is learned from a set of training photo-sketch pairs for modelling the relationship between sketch patches and photo patches. Then, based on the learned coupled dictionary, overlapped photo patches can be synthesized. Afterward, the overlapped photo patches are further selected under the proposed global energy minimization framework based on the Markov network. Finally, a multi-band blending operation is carried out to obtain a photo realistic result. The experimental results are promising and validate the effectiveness of the proposed method by comparing with the several existing methods.
منابع مشابه
Face Sketch-Photo Synthesis and Retrieval Using Sparse Representation
Sketch–photo synthesis plays an important role in sketch-based face photo retrieval and photo-based face sketch retrieval systems. In this paper, we propose an automatic sketch– photo synthesis and retrieval algorithm based on sparse representation. The proposed sketch–photo synthesis method works at patch level and is composed of two steps: sparse neighbor selection (SNS) for an initial estima...
متن کاملShared Representation Learning for Heterogeneous Face Recognition
After intensive research, heterogenous face recognition is still a challenging problem. The main difficulties are owing to the complex relationship between heterogenous face image spaces. The heterogeneity is always tightly coupled with other variations, which makes the relationship of heterogenous face images highly nonlinear. Many excellent methods have been proposed to model the nonlinear re...
متن کاملA Novel Face Detection Method Based on Over-complete Incoherent Dictionary Learning
In this paper, face detection problem is considered using the concepts of compressive sensing technique. This technique includes dictionary learning procedure and sparse coding method to represent the structural content of input images. In the proposed method, dictionaries are learned in such a way that the trained models have the least degree of coherence to each other. The novelty of the prop...
متن کاملBayesian Tensor Inference for Sketch-Based Facial Photo Hallucination
This paper develops a statistical inference approach, Bayesian Tensor Inference, for style transformation between photo images and sketch images of human faces. Motivated by the rationale that image appearance is determined by two cooperative factors: image content and image style, we first model the interaction between these factors through learning a patch-based tensor model. Second, by intro...
متن کاملInstance-Level Coupled Subspace Learning for Fine-Grained Sketch-Based Image Retrieval
Fine-grained sketch-based image retrieval (FG-SBIR) is a newly emerged topic in computer vision. The problem is challenging because in addition to bridging the sketch-photo domain gap, it also asks for instance-level discrimination within object categories. Most prior approaches focused on feature engineering and fine-grained ranking, yet neglected an important and central problem: how to estab...
متن کامل